J) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




© Publication number: 



0 567 931 A1 



® 



EUROPEAN PATENT APPLICATION 



® Application number: 93106577.5 
© Date of filing: 22.04.93 



® Int. CI .5: H04N 5/44, H04N 3/32 



® 


Priority: 30.04.92 EP 92401233 


15, rue du Ziegelfeld 


@ 




F-67100 Strasbourg(FR) 


Date of publication of application: 


Inventor: Bolender, Nadlne 




03.11.93 Bulletin 93/44 


3, rue de Verdun 
F-67000 Strasbourg(FR) 


® 


Designated Contracting States: 


Inventor: Chevet, Jean-Claude 




DE FR GB IT 


3, rue des Charbonnieres 






F-67640 Fegersheim(FR) 


Applicant: THOMSON CONSUMER 
ELECTRONICS S.A. 






9, Place des Vosges, 


® Representative: Einsel, Robert, Dipl.-lng. 




La Defense 5 


Deutsche Thomson-Brandt GmbH 




F-92400 Courbevoie(FR) 


Patent- und Llzenzabteilung 


® 




Gottinger Chaussee 76 


Inventor: Boie, Werner 


D-30453 Hannover (DE) 



@ Method and apparatus for improving sharpness of pictures. 



CO 
CD 

CO 
IT) 



LU 



@ In PCT/EP91/01702 a method for vertical sharpness improving using a luminance level dependent deflection 
is described. But special problems in connection with interlace sources for the input signal are not considered. 
The deflection is uniform for all lines. 

Interlace-progressive upconverted pictures will have an ambiguous vertical transition along horizontal structures 
within the interpolated lines. The vertical transition reaching over two lines leads nevertheless to a significant 
reduction of sharpness in vertical direction. Since there is only the interpolated line which is uncertain with its 
amplitude, only this line should be deflected in vertical direction. Furthermore the vertical deflection is restricted 
to horizontal structures or real vertical transitions, respectively. In order to have a high noise immunity of this 
sensitive processing the resulting luminance amplitude of the shifted line as well as the vertical deflection is 
strongly dependent on the current video signal (soft decision). 
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The present invention relates to a nnethod and to an apparatus for improving sharpness of pictures. 
Background 

5 Spatial ProScan converted (i.e. from a progressive source) interlace pictures exhibit in general unsharp 

transitions in vertical direction (the ProScan or DIAG3 algorithm is described in EP-A-92400762). This 
unsharpness is normally due to a vertical interpolation applied at horizontal structures. The result of that 
kind of upconversion is very often that the original interlace picture looks sharper than the upconverted one. 
In addition to that, large format colour TV tubes producing a high peak brightness in order to be acceptable 

10 in the consumer market possess a large beam current in bright areas and a subsequent defocussing of the 
resulting spot on the display. 

To overcome these fundamental disadvantages the interpolated line, which represents along horizontal 
structures the center of the transition, should be deflected away from the transition region towards the 
adjacent line carrying the higher luminance level. That results in an improved sharpness due to an 
75 enhanced overshoot of the luminance on the screen without increasing the beam current and a subsequent 
enlarged spot size as it is the case with a peaking technique. 

In PCT/EP91/01702 a method for vertical sharpness improving using a luminance level dependent deflection 
is described. But special problems In connection with progressive sources for the input signal are not 
considered. The deflection is uniform for all lines. 
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Invention 



It is one object of the invention to disclose a method of sharpness improving of progressive pictures 
which stem from an interlaced source. This object is reached by the method disclosed in claim 1. 

25 The behaviour of a VSM (vertical scan modulation) method depends strongly on the properties of the 

incoming signal that means whether the input signal stems originally from an interlace source or a really 
progressive one. Because of the nature of the spatial Proscan algorithm the upconverted pictures will have 
an ambiguous vertical transition along horizontal structures within the interpolated lines. The best solution 
implying a linear filter technique for the interpolation represents the vertical interpolation or for a simpler 

30 solution vertical average like in the Proscan algorithm. The vertical transition in that case reaching over two 
lines leads nevertheless to a significant reduction of sharpness in vertical direction. Since there is only the 
interpolated line which is uncertain with its amplitude, only this line should be deflected in vertical direction. 
This strategy has several advantages over a VSM algorithm which creates for each line a deflection signal: 

- Firstly, due to the fact that the original lines are not shifted the objects within the picture will keep its 
35 original size. That is not the case if also the original lines will be shifted. This can lead to an extension 

of the black regions and the pictures become more coarser than the original ones. Also some black 
holes can appear between a grey/white transition. 
• Secondly, by using a deflection signal for each line the interlace artefacts may be increased because 
the contours of the objects appear shifted from its original position. These effects have been observed 
^0 in moving picture parts with fine details Jn which a new annoying moving structure came up. Such 

effects cannot occur, if only the interpolated line is shifted. 

- Thirdly, if this VSM technique is applied in conjunction with a Proscan algorithm, no additional line 
delay becomes necessary. 

Furthermore the vertical deflection should be restricted to horizontal structures or real vertical transi- 
ts tions. respectively. This has also many advantages. This restriction avoids: 

- Firstly, this restriction avoids that again a staircase structure will be introduced at declined structures. 

- Secondly, the processed pictures look more natural in real scenes with human faces including the 
teeth. 

.- Thirdly, the additional deflection only at horizontal structures ensures a flat field reproduction in all 
50 other parts of the picture. 

By this the properties of the Proscan algorithm can be kept and the picture quality is not compromised 
again by "old" interlace distortions or even new artefacts. 

The achieved overshoot and the resulting sharpness at vertical transitions depend strongly on the luminance 
amplitude and the deflection amplitude of the shifted line. In order to have a high noise immunity of this 
55 sensitive processing the resulting luminance amplitude of the shifted line as well as the vertical deflection is 
strongly dependent on the current video signal (soft decision). Also some kind of noise reducing processing 
(averaging) has been foreseen, but nevertheless the resulting deflection signal can occur with a sharp 
transition and necessitates therefore a high bandwidth for a voltage-current converter which drives the 
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additional deflection coil. 

In principle the inventive method consists in improving the sharpness of pictures displayed with a line 
structure on a picture tube, whereby the beam of said tube is deflected in vertical direction in relation to 
brightness transitions with at minimum a vertical component and said deflection is made only for such lines 
5 which are located in-between and are interpolated from original lines of a field. 

Advantageous additional embodiments of the inventive method are resulting from the respective 
dependent claims. 

It is a further object of the invention to disclose an apparatus which utilizes the inventive method. This 
object is reached by the apparatus disclosed in claim 10. 

10 In principle the inventive apparatus comprises a picture tube and an interlace-progressive upconverter 
circuit and a vertical scan modulation unit which generates a signal for additional deflection of the beam of 
said tube in vertical direction in relation to brightness transitions with at minimum a vertical component of 
lines passed from the output of said upconverter circuit to the input of said modulation unit, whereby said 
additional deflection is made only for such lines which are located in-between and are interpolated from 

75 original lines of a field and whereby said modulation unit also changes the brightness of according pixels of 
said interpolated lines in relation to said brightness transitions. 

Drawings 

20 Preferred embodiments of the invention are described with reference to the accompanying drawings, 
which show in: 



Fig. 
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the principle of the vertical scan modulation; 


Fig- 
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a vertical edge with accompanying luminance amplitude differences; 


Fig- 
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a diagonal edge with accompanying luminance amplitude differences; 


Fig. 
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a diagonal edge with unsharp transition; 


Fig. 
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amplitude differences at a horizontal transition and schema of the generated differences 






(diagonal L); 


Fig. 
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schema of the generated differences (diagonal R); 


Fig. 
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circuit for horizontal averaging. 



Preferred embodiments 



As mentioned above the inventive VSM will generate an additional vertical deflection signal only for the 
interpolated lines. Fig. 1 gives an overview of the processing. The spatial Proscan circuit 1 1 supplies from 

35 each input field 12 an output frame 13 containing all the lines which are necessary for the VSM processing. 
That means the actual line y(n + l). the delayed line y(n-1) and the interpolated line y(n) go into the VSM 
processing unit which itself generates a deflection signal 14 corresponding to the interpolated line y(n) and 
generates modified interpolated lines y'(n) with modified amplitude compared to the original interpolated 
line y(n). The deflection signal 14 is used only for the interpolated lines 16 of the frame 13. The tube 15 

40 receives the original lines y(n-1). y(n + 1) and the modified interpolated lines y*(n) and the additional 
deflection signal 14. 

One essential requirement the VSM has to meet is the detection of the horizontal structures because 
only there the scan modulation technique should be applied in order to keep the properties of the Proscan 
algorithm. For that reason the VSM method is based on the assumption that at horizontal structures due to 

45 the vertical average the vertical transition reaches over two tines. That situation is depicted in Fig. 2. Fig. 2a 
shows in a three-dimensional view the vertical transition and Fig. 2b depicts amplitude differences at this 
transition: a first difference Ai between the interpolated line n, 21 and line n + 1, a second difference A3 
between line n-1 and the interpolated tine n and a third difference Aa between tine n-1 and line n + 1. 
For a diagonal structure it is assumed that the vertical transition reaches normally only over one line. Fig. 3a 

50 and 3b illustrate this case respectively. Therefore the first difference Ai between the interpolated line h, 31 
and line n + 1 is zero and the second difference A2 between line n-1 and the interpolated line n is equal to 
the third difference A3 between tine n-1 and line n + 1. 

At a first stage within the VSM processing unit it is checked if there is the same sign of the gradient 
between line y(n-l). line y(n) and line y(n + l) and if the absolute values of both gradients exceed also a 

55 given threshold, e.g. of value 16 in case of 8-bit input samples. That means: 
In principle VSM is enabled, 
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IF { (A^ > threshold AND > threshold) OR 
{A^ < threshold AND A^ < threshold) } 

5 

THEN TEST = 'V. 

with Ai = y(n)-y{n + 1), A2 = y(n-1)-y(n). 

This gives already a very rough selection if the VSM should be enabled or not. 

In a first approach the VSM internal enabling control signal a can be generated according to the 
10 following fornnula: 

IF TEST = 'V THEN a = |A3 1 - ||Ai |-|A2|| 
ELSE a = 0. 

with A3 = y(n-1)-y(n + 1) and Ai and A2 as given above. 
In this formula two linnit cases are to be regarded: 
^5 - if y(n) is a vertical interpolated value (see Fig. 2). Ai equals A2 and a will become a maximum with a 
= |A3|; 

- if there is a diagonal structure as given in Fig. 3, a will become zero, i.e. 
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a 



IF { (A^ = 0 AND A^ = A^) OR 

(A^ = 0 AND A^) } a = 



For a deflection signal 14 (defl) which should not be affected by the quantization error of the signal itself a 
25 resolution of 3 bits is at least necessary (that means a 7-step staircase function should be applied). 

Moreover, the control signal a has to be clipped (aum) and to be signed by the wanted deflection direction. 

According to that the deflection signal defl must be: defl = staircase(aii,„). 

with aiim = 128 + sign(Ai)*min(5.1 27), 5 = a and 8-bit pixel resolution. 

In order to increase the effect of the edge enhancement the luminance value y(n) of the shifted line is 
30 advantageously modified according to the formula: 

y'(n) = min[y(n)"(1 + 5"fac1/256).255]. 

Furthermore the modified signal should not exceed the maximum luminance value of both neighbouring 
35 lines: 



y*(n) = min[y*(n), max(y(n-1 ), y(n + 1 ))], 



Herein the factor fad evaluated by 1.5 has its major influence on transitions between black and grey levels. 

40 This first approach of the inventive VSM method can significantly improve the sharpness at vertical 
transitions along horizontal structures, but unfortunately also parts of diagonal contours can be detected as 
separated small horizontal structures. As a result of this some staircase patterns may occur. The reason for 
this can be explained by means of the transition time of the edges in horizontal direction. Fig. 4 reflects the 
situation of a diagonal edge. Due to a horizontal transition reaching over two pixels the VSM method can 

45 find a vertical transition over two lines as it was depicted in Fig. 2b. The situation in Fig. 4 is not the only 
one which can happen, also more extended transitions are possible in natural pictures. The result is that a 
control signal a is created for a certain number of pixels belonging to a certain part of a declined structure. 
To put this findings into other words, the VSM method will work accurately if the video signal has a 
maximum of horizontal resolution and sharpness corresponding to a given sampling frequency, 

50 In order to overcome these difficulties a detection of the diagonal structures becomes necessary which 
is more sensitive f.l. than in said ProScan (DIAG3) algorithm, because ProScan exhibits certain ambiguities. 
The basic idea of how to overcome these problems is to extend the first approach by detecting horizontal 
transitions which have a transition length of more than one pixel as shown in Fig. 5a. For a better selectivity 
the same technique should be applied in the adjacent lines but with a horizontal offset of one pixel as 

55 depicted in Fig. 5b. Three lines 51 (a). 52 (b) and 53 (c) are depicted, whereby interpolated line 52 includes 
the current pixel 54 (xi). By this one can achieve the maximum sensitivity in diagonal direction. By means of 
separate averages over the various kind of the absolute values a correction value ei can be created: 
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6, = faC2{|A3al| + |A3b(| + |A3cl| 

+ ||Aiat| + |A,b,| + |A,e,| 

-|A2„HA2blHA2cl||} 

5 with fac2 = 0,5 . 

Obviously, the other diagonal direction has also to be checked. For that reason a second correction 
value €r has to be introduced (see Fig. 6): 

er = fac2{|A3ar| + |A3br| + |A3cr| 
70 +||Aiar| + |Aibr| + |Aier| 
-|A2,,HA2b,HA2cr||} 

Three lines 61 (a), 62 (b) and 63 (c) are depicted, whereby Interpolated line 62 includes the current pixel 64 
(Xi). NB: 

Albl = Aibr 
A2bl - A2br 
A3bl ~ Asbr 

20 The resulting control signal 5 can now be fornned by : 
5 = nnax(a-max(€|,6r),0) 

In this formula the correction value o.r compensates in case of a diagonal structure the control signal 6. 
25 Investigations have shown that this algorithm works quite selective that way that only horizontal 

structures will be detected. The diagonal average of the different kind of absolute values in the above 

formulas have also proved to be quite effective in terms of noise immunity. 

Because of the nature of the correction signal extremely fine horizontal structures, only a few pixels 

long, cannot be any more detected, but this has been regarded as negligible. Another drawback based on 
30 the same principle comes up at the beginning and at the end of a horizontal structure. The resulting control 

signal has a reduced active time period that means the raising and trailing edge of the control signal are in 

a region in which the control signal should still have its maximum value. Consequently, at the beginning and 

the end of the horizontal structure the full sharpness cannot be achieved. 

For that reason it is advantageous to average the resulting control signal 5 over five pixels in order to 
35 compensate this unwanted effect. In Fig. 7 the control signal 5 is passed through four pixel delays 721, 722. 
723 and 724. 5 and its four delayed values are combined in adder 73. Each sum is divided by five in 
multiplier 74. The output control signal 5* is then used in the VSM processing unit to calculate anm, defl and 
y'*(n). Despite of that kind of lowpass filtering the resulting control signal can after the control signal clipping 
raise or fall off very quickly so that the voltage-to-current converter necessary for driving the deflection coil 
40 should have a high bandwidth. 

The proposed VSM technique comes up with a significantly improved picture sharpness while the 
picture quality is not compromized by new artefacts introduced by the VSM algorithm. Advantageously also 
a respective horizontal scan modulation technique can be added. 

The soft decision for the generation of the deflection signal as well as for the modification of the 
45 luminance level in the interpolated lines has proved to be a necessity in terms of curved structures. Due to 
several applied averaging techniques the inventive method comes up with a relatively good noise immunity. 

Claims 



50 1. Method for improving sharpness of pictures displayed with a line structure on a picture tube (15), 
whereby the beam of said tube is deflected in vertical direction in relation to brightness transitions (Fig. 
2b, Fig. 3b) with at minimum a vertical component, characterized in that said deflection is made only 
for such lines (16, 21, 31. 41, n) which are located in-between and are interpolated from original lines of 
a field. 

55 

2. Method according to claim 1, characterized in that said deflection is composed of a known standard 
vertical deflection and an additional vertical deflection (14). 
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3. Method according to claim 1 or 2, characterized in that said additional vertical deflection (14) is such 
that at said brightness transitions (Fig. 2b. Fig, 3b) the beam is deflected away to the bright side of said 
transition region. 

5 4. Method according to any of claims 1 to 3. characterized in that the amount of said additional vertical 
deflection relates to pixel difference values derived from the slope and/or from the direction of said 
transition. 

5. Method according to any of claims 1 to 4, characterized in that the amount and the sign of said 
10 additional vertical deflection is a staircase function relating to said pixel difference values, whereby a 

limitation is included. 

6. Method according to any of claims 1 to 5, characterized in that the brightness of respective pixels (xi) 
of said interpolated lines (16, 21, 31, 41, n) is modified according to pixel difference values derived 

;5 from the slope and/or from the direction of said transition. 

7. Method according to claim 6, characterized in that said brightness modification is stronger between 
^ black and grey than between grey and white. 

20 8. Method according to any of claims 1 to 7. characterized In that a control signal from which the 
amount of said additional deflection and/or the amount of said brightness modification is derived is 
averaged over several, especially five, pixels. 

9. Method according to any of claims 1 to 8, characterized in that a respective additional deflection in 
25 horizontal direction is added to said vertical additional deflection. 

10. Apparatus for a method according to any of claims 1 to 9. comprising a picture tube (15) and an 
interlace-progressive upconverter circuit (11) and a vertical scan modulation unit (VSM) which gen- 
erates a signal for additional deflection of the beam of said tube in vertical direction in relation to 

30 brightness transitions (Fig. 2b, Fig. 3b) with at minimum a vertical component of lines (y(n-1), y(n), y- 

(n + 1)) passed from the output of said upconverter circuit to the input of said modulation unit, whereby 
said additional deflection is made only for such lines (16, 21. 31, 41. n) which are located in-between 
and are interpolated from original lines of a field and whereby said modulation unit also changes the 
brightness of according pixels (xj) of said interpolated lines in relation to said brightness transitions. 

35 
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